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ABSTRACT 

A large sample method for obtaining asymptotic 
simultaneous confidence bands for a three-parameter logistic respons?i 
curve is described. Simultaneous confidence bands indicate the 
sampling variation of item response curves relative to a fitted 
function. A procedure is given which requires as input maximum 
likelihood parameter estimates and an asymptotic error covariance 
matrix. Illustrative plots of item response curves with corresponding 
confidence bands are presented. These procedures are simple enough 
computationally to be used economically in regular item response 
studies. Incorporating the calibration and graphical display of 
simultaneous confidence bands i*ito calibration software would greatly 
benefit test designers. (Contains four figures and seven references.) 
(Author/SLD) 
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Confidence Bands for the Three -Parameter Logistic 
Item Response Curve 

Abstract 

A large sample method for obtaining asymptotic simultaneous 
confidence bands for a three-parameter logistic response curve is 
described. A procedure is given which requires as input maximum 
likelihood parameter estimates and an asymptotic error covariance 
matrix. Illustrative plots of item response curves with corresponding 
confidence bands are presented. 
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Confidence Bands for the Three- Parameter Logistic 
Item Response Curve 

Introduction 

The three-parameter logistic (Birnbaum) item response function is 
commonly used to model latent abilities in psychometric studies. In 
most situations maximum likelihood parameter estimates are obtainable 
through computer packages such as LOGIST (Wingersky, 1985; Wingersky, 
Barton, & Lord, 1982). Unfortunately, simultaneous confidence bands 
for the resulting item response curves have not been available to 
psychometricians . 

A graphical approach using N-line plots for the three -parameter 
model has been suggested by Thissen and Wainer (1983a, 1983b). This 
technique is convenient for determining the density of curves in the 
confidence envelope corresponding to any mono tonic function. However, 
the number of curves needed to obtain 95% confidence bands for the 
three -parameter logistic model is 235 , which is far too many to plot 
in most practical situations. 

Hauck (1983) developed a procedure for obtaining confidence bands 
for any model whose logit is linear in the parameters. This method is 
similar to those of linear regression models and may be applied to the 
two - parame ter logistic response function. Unfortunately, the addition 
of a guessing parameter negates the applicability of Hauck' s approach 
to the three-parameter model. 

A procedure specifically for determining large sample confidence 
bands for the two -parame ter logistic model was first developed by 
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Brand, Pinnock, and Jackson (1973). Their method involved solving 
algebraically for extrema on the confidence ellipse for the logit 
model parameters. Obtained minima and maxima, for various latent 
ability values, may then be used to form simultaneous confidence bands 
for the response curve. 

A similar approach is taken here for the three -parameter logistic 
model. While explicit formulas for the confidence regions are not 
available in this case, a convenient numerical procedure is presented. 
Examples of confidence bands for SAT test items are given. 



where L » AS + B , 0 is the usual ability parameter, and A, and B and c 
are item parameters, .See the Appendix for the relationship between 
this equation and the more common formulation given by Lord (1980). 

For a given item, the asymptotic distribution of the maximum 



Background 



The form of the logistic function used throughout this paper is 




0 < c < 1, 



( 1 ) 



likelihood estimator of the item parameters ■ (A,B,c) , assuming the 



Sq (a - 1, 2, ..., N) to be known, is the normal trivariate 



distribution 




(2) 
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where ft (A,B,c)' and V*' is the Fisher information matrix. Since 
the quadratic form in the exponent of a normal distribution is 
distributed as chi-square, in repeated sampling, asymptotically 

Prob[(/i - ^ (ft - ft) < 1 M. V] - 1-a (3) 

where is the 100 (1-a) -th percentile of the chi-square 

distribution with three degrees of freedom. 

A 

The matrix V may be replaced by V without changing the asymptotic 
validity of (3). An asymptotic (l-o) confidence region for ft may be 

A 

computed from observed sample values ft and V: 

(ft - ft)' V ^ (ft - ft) < ^i-a ■ 

For given 6, let Pj^{6) and Pv{8) denote the minimum and maximum 
values of P{6) found within the ellipsoid region (4). Now consider 
Pl(^) and Pv(8) as functions of B, defining a confidence band within 
which the true P(8) is asserted to lie. 

Consider drawing repeated samples. From each sample, construct an 
ellipsoid region (4). In 1-a of the samples, the ellipsoid will 
contain the true parameter value ft. Corresponding to each ft is the true 
item response function P{8) . When ft lies within the ellipsoid (4) 

Pi^(8) < PiB) < Pi, (8) . (5) 



Since ft lies within the ellipsoid in 1-a of all the samples, the 
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inequality (5) will hold for at least 1-a of all samples. Thus the 
assertion that (5) holds will be correct at le^st 1-a of the time in 
repeated sampling. The words 'at least' are necessary here because (5) 
may also hold for some of the samples in which lies outside the 
ellipsoid. From this result follows the 'simultaneous' property that 
in 1 - a of the samples the entire curve will fall between Pl and Pij. 

It remains to find for each 0 the maximum and minimum values of 
P(9) within the ellipsoid (4). Previous attempts to do this [by F. M. 
Lord (personal communication), and by Thissen and Wainer (1983a, 

1983b)] found maxima and minima of P(0) on the boundary of the 
ellipsoid region. M. L. Stocking (personal communication), however, 
demonstrated that these maxima and minima were sometimes local rather 
than global. It remains to find the largest local maximum and the 
smallest local minimum. 



Reformulating the Optimization Problem 



In order to simplify the constraint space given in (4) , consider 
the following. Define 
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Li 



Confidence Bands 



7 



Thus 




( 8 ) 



where S*^ ■ . Similarly (4) may be written 



(i/ - v) S (i/ - v) S ^ 



2 

1 -a 



(9) 



This represents a change in coordinate axes, reexpressing the ellipsoid 
region (4) in A, B, c as an ellipsoid region (9) in A, L, c for a given 

e . 

For fixed 6, consider how the item response function (1) varies 
with L and c. The first partial derivatives are 

dP(6) 1 - c 

dL “ (1 + e'^)(l + e-’^) ’ 

dP{9) 1 ni 

dc 1 + e^ • 

Since both of these derivatives are always positive, within any given 
ellipsoid both the minimum and the maximum values of P(6) for any 
fixed $ will be found on the boundary of the ellipsoid. That is, the 
constraint space (9) may be reduced to the ellipsoid 



( 1 / - I/) S (i/ “ »') 




( 12 ) 
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Numerical Solution 

For fixed 6, the problem is to find the values of A, L, and c 
satisfying (12) that yield the extrema of P(d ) . This nonlinear 
maximization problem (with quadratic constraints) can be solved using 
La/^range multiplier method. The Lagrange function is 



3 3 



P(d) - I > ( Z Z 



(13) 



i J 



where ^ the Lagrange multiplier, » ^nd = S 

The desired extrema of P(^) are found by setting equal to zero 
the derivatives of the Lagrange function with respect to A, L, and c. 
Using (10) and (11), these derivatives are 



I “ 0 . 

j 



(14) 



B: 



(1 - c)r 



1 + ^ I ° - 



(15) 



and 



c : 



1 ^ 

1 ^ ^ 5 ° ’ 



(16) 



where r » 1/(1 + e"^). 

To solve for A, multiply (14) by v^ , (15) by v^ , (16) by Vg and 
add to find: 



r(l - C)V2 Vg 



3 3 



r — + r ** A y y i 

4- e^ 1 4- e^ ^ ^ -i J 
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2 

By (12) the double sum is so 



QjC + P2 
I + 



r(l - c'lVj + c - c 
+ e^-) 



(17) 



where 



Qj * (1 - rv^)/X^.^ , /Sj “ (^2 • • 



An expression for c as a function of L and known quantities is now 
developed. From (14) , 



V 



1 



-;“(V2f^l2 + f^l3<= - f^iaC) - OCyC + /3i 
1 



(18) 



where 



Qj * “^13/^11 » " (^ 13 ^ ~ 



Substitute (17) and (18) into (16): 



0 1 - (^2^ ^ ^ ^ ^32^2 ^33^ ** ^33^1 

- 1 - (ajC + ^3) » 



where 



^3 " ^3 1^1 ^3 3 » 



^3 * ^ 31^1 ^ 32^2 ** ^ 33 ^ 
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If and ag are non- zero, solve the quadratic for c: 




This expresses c as a function of L and the known quantities c, 
L ^ Ad + S. 

Substitute (17) into (15) to find 



By substituting (19) for c in (18), can be expressed in terms of L 
and known quantities. Substituting this result, along with (19), into 
(20) yields an equation in the single unknown L, which will be denoted 
by G{L) . This equation must be solved numerically (for each fixed 
B) to find all roots. For each root, compute from (1) and (19) the 
corresponding F(^). The largest and smallest values of P(^) so 
obtained (for fixed B) are F^;(^) and Pl(^). 

In order to find all the roots of G{L ) , it is helpful to know the 
maximum and minimum values of L satisfying (12). Setting G(L) - 0, the 
function can be evaluated (for fixed ^) at a large number of equally 
spaced values of L covering the range between the maximum and minimum 
values of L. Any interval in which G(L) changes sign can then be 
searched, using regula falsi, to find the root in that interval. 

To find the extrema of L satisfying (12), let 



3 



(1 - c)r - (qjC + ^ 2 ) Z “ 0 • 



( 20 ) 



3 3 



F(A,L,c) - Z Z - 0 . 



( 21 ) 
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Then if (21) is viewed as defining L as a function of A and c, 



dA “ "Svjtjj ’ 



dL 

W m ' “ 

3 c 2 V j ^ *2 J 



Setting these derivatives equal to zero gives 



and 






+ V2ti2 + ^3ti3 



- 0 



Vjt3i + V2t32 + V3t33 



( 22 ) 



Eliminate to find 



V 



3 



(^3 1^12 " ^ 11^3 2)'^2 

2 * 0=4^2 * 

^31 " ^11^33 



(23) 



say . Similarly 



(^31^23 " ^3 3^12) ^^2 

- t t 

^31 ^11^33 



Substitute (22) into (21) to find 



VjSvjtjj - ■ 



Substitute (23) and (24) into (25) to find 



(® S ^21 ^22 ^ 4 ^ 23 )'^ 2 ' 



2 _ X 



1 -a 



(24) 



(25) 
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Thus the extrema of L satisfying (13) are given by 



L =** L ± ^22 **’ ^4^23^] ^ 



(26) 



The required values of * V ^ are given in the Appendix. 



Examples 

The above procedure was applied to 60 items from an SAT 
mathematical section which had been given to 2691 examinees. The 
parameter estimates were obtained from a LOGIST run at ETS. 
Simultaneous 95% confidence limits for four of the 60 items are 
presented here. 

The item response curve and corresponding confidence bands for 
Item 1 are given in Figure 1. The simultaneous confidence bands are 
similar to those found for simple linear regression lines in that they 
are quite narrow in the neighborhood of the mean of the distribution 
and flare out in the tails. The upper tails of the confidence bands 
are restricted by the asymptotic constraints particular to item 
response curves. 



Insert Figures 1, 2, 3, and 4 about here 



The effects of these constraints on the upper tail are clearly 
shown in Figure 2 which contains the results for Item 2. Here the 
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confidence bands begin to widen around the upper portion of the 
response curve but are then forced back together due to the upper 
asymptotic constraint. Ir. contrast, the lower portion of the 
confidence bands for this item appear to be reaching a constant width. 

This behavior, which is particular to the lower tail of the 
response curve, is even more evident in the results for Item 3 which 
are presented in Figure 3. As the response curve depends primarily on 
the parameter c in the lower tail the variance contributing to the 
width of the confidence bands becomes increasingly dependent only on 
the variance related to c. 

The results for Item 4, contained in Figure 4, contrast those for 
Item 3 in that the lower tail band is still widening while the upper 
portion is fairly constant until the function constraints narrow the 
band. Of course, if the plotted range of abilities was increased 
enough all item confidence bands should show similar characteristics: 
Asymptotically constant about the lower tail with the width of the band 
determined by the variance associated with c; narrowing about the mean 
of the distribution; first widening and then converging to the item 
response curve due to the asymptotic constraints in the upper tail. 
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Discussion 

While standard errors for estimates of the three-parameter 
logistic item response model have been available to psychoraetricians , 
assuming abilities are known (see Lord, 1980, p. 191) precision 
information related to an entire response curve has not. Simultaneous 
confidence bands indicate the sampling variation of item response 
curves relative to a fitted function. This information is more 
relevant to psychometricians than standard errors corresponding to the 
parameter estimates as it provides for more insight into the behavior 
of item functions and hopefully their associated predictive limits. 

The procedures outlined in this paper are simple enough 
computationally to be utilized economically in regular item response 
studies. Clearly, incorporating the calibration and graphical display 
of simultaneous confidence bands into calibration software would 
greatly benefit test designers. 
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Appendix 

r's 

The required values of W II * V are obtainable from the usual 
Fisher information matrix for a, 5, and c (Lord, 1980, p. 191), as 
follows : 



A ~ Da , B - -Dab , 






^12 ^ -D"2a-i(I^ - , 



^2 2 






1^13 - D-Klac " . 



1^23 „ -D-ia“iI|t>c > 



p3 3 



I 



cc • 
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Item 1: A = 1.10 B = -1.29 c = 0,20 



He) 




Latent Ability (0) 



Figure 1. 

Item response function and corresponding simultaneous confidence 
bands for Item 1 from an SAT mathematical section. 
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Item 2: A = 2.14 B = -0.87 c = 0.36 

m 




Latent Ability (0) 



Figure Z, 

Item response function and corresponding simultaneous confidence 
bands for Item 2 from an SAT mathematical section. 



Confidence Bands 



19 



Item 3: A = 2.43 B = -6.85 c - 0.07 

m 




Latent Ability (0) 



Figure 3, 

Item response function and corresponding simultaneous confidence 
bands for Item 3 from an mathematical section. 
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Item 4: A = 1.52 B = 1.63 c = 0.15 

P(9) 




Figure 4. 

Item response funrtion and corresponding simultaneous confidence 
bands for Item 4 from an mathematical section. 





